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Abstract 

We consider classical representations of integers: Church's func- 
tion iterators, cardinal equivalence classes of sets, ordinal equivalence 
classes of totally ordered sets. Since programs do not work on ab- 
stract entities and require formal representations of objects, we effec- 
tivize these abstract notions in order to allow them to be computed by 
programs. To any such effectivized representation is then associated 



1 



a notion of Kolmogorov complexity. We prove that these Kolmogorov 
complexities form a strict hierarchy which coincides with that obtained 
by relativization to jump oracles and/or allowance of infinite compu- 
tations. 

1 Kolmogorov complexities 

We shall use the following notations. 
Notation 1.1. 

1) Inequality, strict inequality and equality up to a constant between func- 
tions N — >■ N are denoted as follows: 



2) (resp. X ^ Y) denotes the set of total (resp. partial) functions from 
X into Y. 

3) We denote tpe the partial recursive function N ^ N with code e. 

4) We denote card{X) the number of elements of X in case X is a finite set. 

1.1 Kolmogorov complexity 

Definition 1.1 (Kolmogorov, 1965 [5]). 

Kolmogorov complexity X : N ^ N is defined as follows: 

K{n) is the shortest length of a program which halts and outputs n 

To make Def. II. II meaningful, some points have to be precised: 

(Ql) Where are programs taken from? In which alphabet? 

Bigger the alphabet, shorter the programs. We shall therefore fix 
the alphabet of all programming languages to be binary. Now, Kol- 
mogorov's invariance theorem insures that there exist optimal uni- 
versal programming languages U such that, for any programming lan- 
guage y, the associated complexity functions Ku,Kv satisfy Ku<ctKv 
(cf. Notations II. ip . In particular, if Ui,U2 are two optimal universal 
programming languages then Kjj-^ =ctKi/^ . 

(Q2) What does it mean that a program outputs an integer n ? 

A program can only output a formal object such as a word in some 
alphabet which represents n. However, there is again an invariance 
property relative to the usual representations of the output integer n 
: up to a constant, the same complexity functions are obtained when 
considering unary representation or base k representation for k > 2 



f <ct g 
f <ct g 
f =ct g 



4^ 3c Vn {fin) < g{n) + c) 

^ /<ct5 A Vc 3n (/(n) < g{n) - c) 

<J4> 3c Vn (|/(n) - 5((n)| < c) 



f<ctg A g<ctf 



(cf. [7] or [U or [lO]). 
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The question aroused by {Q2) is the core of this paper. We shall reconsider 
it in Pand P 



1.2 Infinite computations and oracles 

Chaitin, 1976 [3j, and Solovay, 1977 pjj, considered Kolmogorov complexity 
of infinite objects (namely recursively enumerable sets) produced by infinite 
computations. 

Allowing programs leading to possibly infinite computations but finite out- 
put (i.e. remove the sole halting condition) , we get a variant of Kolmogorov 
complexity for which the results mentionned in (Ql) above also apply. 

Definition 1.2. 

Allowing programs with possibly infinite computations, Kolmogorov com- 
plexity K°° : N ^ N is defined as follows: 

K^{n) is the shortest length of a (possibly non halting) program which 
outputs n in unary representation 

Remark 1.1. 

The definition of K°°{n) is dependent on the unary representation of out- 
puts: (Q2) does not apply. 

Kolmogorov complexity can also be considered for computability relative 
to some oracle. 

Definition 1.3. 

Considering partial recursiveness relative to some oracle A, Def. 11.11 11.21 
lead to relative Kolmogorov complexities : N ^ N and K^^°° : N ^ N. 
In case ^ = 0* is the i-th jump (i.e a S-'-complete set of integers), we simply 
write K\K'^°°. 

For explicit values i = 1, 2, ... we also write K\ K" . . . , K"^ . . .. 

Jump oracle 0' (resp. 0",. . . ) allows the computation to decide for free 
(in a single computation step) any or (resp. Eg or Ilg,. . . ) statement 
about integers. As expected and is well known, such an oracle leads to an 
extended notion of programs. Which allows to 

• compute non recursive sets and functions, 

• get much shorter programs to compute finite objects or recursive sets 
and functions, namely K>ctK'>ctK">ct • • •• 

Infinite computations also lead to shorter programs but, as proved by Becher, 
2001 m, they do not help as much as the jump oracle. 



Proposition 1.1 ([1] 

^ct^ '^ct^ ^ct-f^ ^ct-f^ ^ct 



i^>eti^°°>cti^'>cti^'°°>cti^">r 
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1.3 Prefix Kolmogorov complexities 

Introduced by Levin ^ and Chaitin ^ (cf. (Tj), prefix complexity : N — > 
N is the analog of Kolmogorov complexity obtained by restricting program- 
ming languages to be prefix-free: two distinct programs have to be incompa- 
rable with respect to the prefix ordering. Variants H\ H" . . . , H°°,H'°° , . . . 
involving infinite computations and/or relativization are defined in the ob- 
vious way. 

As concerns all questions considered in this paper, everything goes through 
with straightforward changes. So that we shall deal exclusively with the K 
complexity and its variants K°°, K' , K'°° , K" , .... 

2 Representations of integers 

The purpose of the paper is to consider particular representations of integers 
and to study their influence on the definition of Kolmogorov complexity as 
pointed in question {Q2) relative to Def. Il.ll above. This will lead to a strict 
hierarchy of Kolmogorov complexities which happens to coincide with that 
obtained in Prop. 11.11 

2.1 Abstract representations of integers 

A representation of integers involves some abstract object C (in practice 
much more complex than N itself) such that some of its elements char- 
acterize the diverse integers through some property. Each representation 
illuminates some role and/or properties of integers. 

Definition 2.1. 

A representation of integers is a pair (C, R) where C is some (necessarily 
infinite) set and ii is a surjective partial function ii : C ^ N. 

Remark 2.1. 

In practice, Domain(R) will be a strict subset of C, in fact a very small 
part of C. 

Example 2.1. 

1) The unary representation of integers corresponds to the free algebra built 
up from one generator and one unary function, namely and the successor 
function x x + 1. 

2) The various base k (with k > 2) representations of integers also involve 
term algebras, not necessarily free. They differ by the sets of digits they 
use but all are based on the usual interpretation (i„ ... dido i—> X]j=o n 
which, seen in Horner style: 

k{k{. . . k{kdn + dn-i) + dn-2) . . .) + di) + do 
is a composition of applications Sd^ o Sd^ o . . . o Sd„ (0) where Sd ■ x ^ kx + d. 
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If a representation uses digits d & D then it corresponds to the algebra 
generated by and the S^s where d D. 

i. The /c-adic representation uses digits 1,2, ... ,k and corresponds to a 
free algebra built up from one generator and k unary functions. 

ii. The usual fc-ary representation uses digits 0,1, . . . ,k — 1 and corre- 
sponds to the quotient of a free algebra built up from one generator 
and k unary functions, namely and the S^'s where d = 0,2,... ,k — l, 
by the relation 5o(0) = 0. 

iii. Avizienis base k representation uses digits —k + 1, . . . , — 1, 0, 1, . . . ,k — 
1, (it is a much redundant representation used to perform additions 
without carry propagation) and corresponds to the quotient of the 
free algebra built up from one generator a and 2k — 1 unary functions, 
namely and the S^s where d = —k + 1, . . . , —1, 0, 1, . . . , A; — 1, by the 
relations Vx {S-k+i o Sj+i{x) = SiO Sj{x)) where —k < j < k — 1 and 
<i < k. 

3) R : — > N such that R{x, y, z, t) = x"^ + + + is a representation 
based on Lagrange's four squares theorem 

4) R : Prime-'^ — > N such that R{xi, . . . , Xi) = xi + . . . + Xi (with i < 7) 
is a representation based on Schnirelman's theorem (as improved by Ra- 
mar, 1995) which insures that every number is the sum of at most 7 prime 
numbers. 

Besides such number theoretic representations of integers, we shall con- 
sider classical set theoretic representations involving higher order objects. 

Example 2.2. 

1) Church's representation. 

Integers are viewed as function iterators (which are type 2 objects) / i-^ Z*-"^ 
where f^^^ = Id and /("+^) = _/"(") o /. Thus, C is the class containing all 
functional sets {X X)^^^ (cf. Notations II. ip and R is defined on the 
proper subclass of C constituted of functionals which are finite iterators on 
some X ^ X and i?(F) = n if and only if F(/) = for all f :X ^ X. 

Ibis) Z-Church's representation. 

Negative iterators / ^ /(~") are defined as follows: 

i. Domain{f^~"-^) = Range{f^"'^) 

ii. /^""•'(x) = y if y is the smallest such that f^^\y) = x (relative to 
some fixed well-order on X) 

The definitions of C and R are analog to that in point 1. 

2) Cardinal representation. 

Integers are viewed as equivalence classes of sets relative to cardinal compar- 
ison. Thus, C is the class of all sets and R is defined on the proper subclass 



5 



of C constituted of finite sets and R{X) is tlie cardinal of the set X. 

3) Z-Cardinal representation. 

Relative integers are viewed as differences of natural integers which are them- 
selves viewed via cardinal representation. Thus, C is the class of all pairs of 
sets and R is defined on the proper subclass of C constituted of finite sets 
and R{X, Y) is the difference of the cardinals of X and Y. 

4) Ordinal representation. 

Integers are viewed as equivalence classes of totally ordered sets. Thus, C 
is the class of totally ordered sets and R is defined on the proper subclass 
of C constituted of finite totally ordered sets and R{X) is the order type of 
X. 

2.2 Formal representations of integers 

A formal representation of an integer n is a finite object (in general a word) 
which describes some characteristic property of n or some abstract object 
which characterizes n. In fact, each particular representation is really a 
choice made in order to access special operations or stress special properties 
of integers. 

The computer science (or recursion theoretic) point of view brings an ob- 
jection to the consideration of abstract sets, functions and functionals as we 
did in Example 12. 2t 

• We cannot apprehend abstract sets, functions and functionals but solely 
programs to compute them (if they are computable in some sense). 

• Moreover, programs dealing with sets, functions and functionals have 
to go through some intensional representation of these objects in order 
to be able to compute with such objects. 

Thus, to get effectiveness, we turn from set theory to recursion theory and 
"effectivize" abstract sets: 

• sets of integers will be recursively enumerable (r.e.), i.e. domains of 
partial recursive functions, 

• functions on integers will be partial recursive, 

• functionals will be partial recursive in the sense of higher type recur- 
sion theory (cf. usual textbooks [9] or [8]). 

Though abstract representations are quite natural and conceptually simple, 
their effectivized versions are quite complex: the sets of programs computing 
objects in their domains involve levels 2 or 3 of the arithmetical hierarchy. 
In particular, such representations are not all Turing reducible one to the 
other. In the sequel we shall only consider type < 2 representations. In 
order to get the adequate notion of recursion-theoretic representations of 
integers, we have to review some higher order recursion concepts. 
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2.3 Effectivization of sets of type < 2 objects 

First, we recall the notion of type 2 recursion that we shall use. 
Definition 2.2 (Effective operations). 

Let X, Y, Z, T be type spaces (i.e. N, N'^, {0, 1},. . . ). We denote PR{X 
Y) the set of partial recursive functions X ^ Y. 

An effective operation F : PR{X ^ Y) ^ PR{Z T) or F : PR{X 
Y) ^ Z is an operation which can be defined via partial recursive operations 
on the Godel numbers of partial recursive functions. In other words, letting 
jjPR{X^Y) {;ig]2ote a partial recursive enumeration of PR{X — > Y), there 
exists / such that the following diagram commutes 

PR{X Y) — ^ PR{Z T) 



jjPR.(X^Y) 



{0,1}* — U {0,1}* 

We denote Eff{{X ^ Y) ^ {T ^ Z)) (resp. Eff{{X ^ Y) ^ Z)) the 
family of effective operations from PR{X — > Y) into PR{Z T) (resp. 
into Z). 

Let's recall the following fact. 

Theorem 2.1 (Myhih & Shepherdson, 1955). 
Effective operations 

F : PR{X ^Y) ^ Z (or F : PR{X ^Y) ^ PR{Z ^T)) 
are exactly the restrictions of effectively continuous junctionals 

F -.Y^ Z (or F :Y^ ^ ) 
in the sense of Uspenskii, 1955 (cf. Rogers 19], or Odifreddi fE/)- 

Definition 2.3 (Effectivization of higher type sets). 

1) The effectivization of the type 1 sets Y-^ and X ^ Y is the subset 
PR{X — >• Y) of partial recursive functions. 

2) The effectivization of the type 2 set (T^)^^ (resp. Z^^) is the subset of 
effective operations PR{X ^Y)^ PR{Z T) (resp. PR{X ^Y)^ Z). 

We can now define strongly universal partial recursive functions and 
strongly universal effective operations. 

Definition 2.4 (Universal enumerations). 

Let X, Y, Z, T be type sets and let f be X or PR{X Y) (resp. Eff{{X 
Y)^{Z^T))). 

1) A partial recursive function (resp. effective operation) U : {0, 1}* ^ £" is 
universal if there is a recursive function comp : {0, 1}* x {0, 1}* {0, 1}* 
such that if we denote Ue the function such that f/e(p) = f^(comp(e, p)), 
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then the family {Ue)ee{o,i}* is an enumeration of the class of partial recur- 
sive functions (resp. effective operations) from {0, 1}* to £. 
Intuition: Words in {0, 1}* are seen as programs. A partial recursive func- 
tion (resp. effective operation) {0, 1}* £ maps a program to the object it 
computes (which lies in £). Function p i— > comp(e,p) is therefore seen as a 
compiler. 

We say that e is a Godel number for F G £ if F = U^- 

2) U is strongly universal if it is universal and for each index e, there is a 
constant c(e) such that for all p G {0, 1}*, we have 

|comp(e,p)| < |pj + c(e) 

The following theorem is a classical result of recursion theory which is 
crucial for the definition of Kolmogorov complexity in §2.51 

Theorem 2.2. 

There exists a strongly universal partial recursive function (resp. effective 
operation). 

Moreover, one can suppose that comp is the pairing function (, ) defined by 

(e, p) = Ip , (eie2 • • • e„, p) = 0ei0e2 • • • Oe^lp 
which satisfies the equality 

|(e,p)| = |p|+2 |e| + l 

2.4 Recursion-theoretic representations of integers 

Finally, we are in a position to introduce the wanted definition. 
Definition 2.5 (Recursion-theoretic representations). 

A recursion theoretical representation of N (resp. Z ) is any surjective 
function p : C — > N (resp. p : C — > Z) where C is the effectivization £ of 
some higher type set. 

We use Example 12.21 to illustrate the effectivization processes described 
in g231 

Example 2.3. 

1) Effective Church and Z-Church representations. 

Iterators /t„ : Pii(N —>■ PR(N N) of partial recursive functions 

are inductively defined as follows for n € N : 
i- Itoif) = f 

it. Itn+lif) = Itnif) O f 

Negative iterators : PR{N ^ N) ^ PR{N N) are defined as 

follows: 

Hi. It-n{f) has domain Range{Itn{f) 

iv. It-n{f){x) = y ii Itn{f){y) = x and Itn{f){y) is the first halting 
computation among all computations ltn{f){0), Itn{f){l), ■ ■ ■■ 
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We let Church^ : Eff{(N ^ N) ^ (N ^ N)) ^ N be so that 

Church^ (F) = n if F = Itn for some n G N , otherwise undefined 

and Church'^ : £^//((N ^ N) ^ (N ^ N)) ^ Z be so that 

Church^ {F) = n if F = Itn for some n G Z , otherwise undefined 

2) Effective cardinal and Z-cardinal representations. 

We let card^ : PR{N ^ N) ^ N be so that 

i. card^{f) is defined if and only if domain{f) is finite 

ii. card^{f) = card{domain{f)) 

We let card'^ : PR{N ^ N) x PR{N ^ N) ^ Z be so that 

in. card'^{f, g) is defined if and only if /, g have finite domains 
iv. card'^{f, g) = card{domain{f)) — card{domain{g)) 

3) Effective ordinal representation. 

We let ord^ : PR(N^ ^ N) ^ N be so that 

i. ord^{f) is defined if and only if the quotient order associated to the 
transitive closure of domain{f) is finite 

ii. ord^{f) is the order type of this quotient order. 

The following result measures the syntactical complexity of the domain 
and the graph of the functionals Church^ , Church'^, car d^ , car d'^, or d in 
terms of the associated index sets. 

Proposition 2.1 (Syntactical complexity of representations). 

1) Church representations. 

The set of pairs (e,n) such that n G N (resp. n G Z) and e is a Gddel 
number for the iteration functional Itn is I\!^-complete. 
The set of Gddel numbers of effective functionals in the domain of Church}^ 
(resp. Church'^) is T,^-complete. 

2) Cardinal representations. 

The set of pairs (e,n) such that n G N (resp. n g7i) and e is the Gddel 
number of a partial recursive function the domain of which is finite with n 

elements is Yi^-complete. 

The set of Gddel numbers of partial recursive functions with finite domains 
is T}2-complete. 

3) Ordinal representation. 

The set of pairs (e, n) such that n G N and e is the Gddel number of a par- 
tial recursive function N such that the quotient order associated to 

the transitive closure of domain{ f) is finite with n elements is Ti^y complete. 
The set of Gddel numbers of partial recursive functions such that the quo- 
tient order associated to the transitive closure of domain{f) is finite is Sg- 
complete. 
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2.5 Kolmogorov complexity and representations of integers 

The usual definition of Kolmogorov complexity can be extended to any 
recursion-theoretic representation of integers. 

Definition 2.6 (Kolmogorov complexity relative to a representation). Let 
E be the effectivization of some higher type set and let /3 : iS — > N (resp. 
/9 : — > Z) be a recursion-theoretic representation of integers. 
Considering the diagram 

{0,1}* 

where is some strongly universal enumeration of Kolmogorov com- 
plexity Kp : N — > N is defined as 

K^{n) = min{|p| : p(JJ^ (j>)) = n} 

The definition of Kp : Z ^ N is analog. 

Theorem 12.21 implies an invariance theorem for strongly universal enu- 
merations. Which insures that the above definition does not depend (up to 
a constant) of the particular choice of the strongly universal enumeration 

of e. 

Remark 2.2. The domain of /?o is not recursively enumerable in general 
(cf. Prop. EH). 

3 Main Theorem 
3.1 Main theorem 

Reconsidering the answer to ((52) given after Def. II. 1^ the main theorem of 
this paper insures the following. 

• Kolmogorov complexity is much dependent on the chosen higher order 
effective representations of integers, 

• The Kolmogorov complexities associated to representations of Exam- 
ple 12.31 constitute a hierarchy which coincides with that obtained with 
infinite computations and relativization to the jumps (cf. Prop. II. ip . 

Thus, Kolmogorov complexity measures the complexity of higher order ef- 
fective representations and allows to classify them. 

Theorem 3.1 (Main Theorem). 

K^hurch^ ^Church^ ^^ard^ ^c^d^ ^ord be the Kolmogorov complexities as- 
sociated to the effective versions of the higher order representations described 
in Example \2.3[ Then 

^Church=ctK^'hurch \^=ctK 
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-"■carrf— ct-fV 

So that we have 

^Church =ct K'^hurch \^ >ct ^^rd >ct ^^rd tN >ct -^ord 

3.2 Representations p such that Kp = K 

The following theorem gives simple sufficient conditions on representations p 
so that the associated Kolmogorov complexity Kp be equal, up to a constant, 
to usual Kolmogorov complexity K. 

In particular, these conditions will apply to Church's representations. 
Theorem 3.2. 

Let £ he PR{X Y) or Eff{{X ^ Y) ^ {Z T) and : {0, 1}* £ 
be strongly universal. Let p : £ ^ N (resp. p : £ ^ Z) be a representation 
of integers. 

Consider the following conditions: 

(*) poU^ is the restriction to its domain of some partial recursive function 
/:{0,ir (f:{0,ir^Z). 

(**) p is effectively surjective: there exists a total recursive function g : 
N {0, 1}* (resp. g : Z {0, 1}*) such that p{U^{g{n))) = n for all 
n G N (resp. n G 

1) Condition (*) implies K<ctKp. 

2) Condition (**) implies Kp<ctK. 

Proof. 

1) Let n G N and let p G {0, 1}* be a minimal length program such that 
p{U^{p)) = n. Then Kp{n) = \p\. Condition (*) implies f{p) = n. There- 
fore, viewing / as a programming language and using Kolmogorov's invari- 
ance theorem there is a constant c independent of n such that 

K{n) < Kf{n) + c < \p\ + c = Kp{n) + c 

Thus, K<aKp. 

2) Let : {0, 1}* — N be a strongly universal enumeration of N. The 
strong universality of insures that there exists e such that 

V;, U^{g{U''{p))) = U^i{e,p)) 

Let n G N and let p G {0, 1}* be a minimal length program such that 
U^(p) = n. Then K(n) = \p\. 
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Condition (**) implies p{U^ ig{U^ (p)))) = n. Thus, /9(C/^((e,p))) = n, 
whence (using Thm [2T2]) 



Kp{n) < \{e,p)\ = \p\ + 2|e| + 1 = K{n) + 2|e| + 1 
and therefore Kp<ctK. □ 
Corollary 3.1. 

^Church— ct^^Church \'^=ctK 

Proof. 

We show that conditions (*) and (**) of Theorem 13.21 are satisfied for the 
p associated to -K'cTmrc/i- "^^^ argument also applies with straightforward 
modifications to K^^^^^^f^ fN. 

To get condition (**), just design a program for functional Itn- 

As for condition (*), let £ = Eff{(N ^ N) ^ (N ^ N)) and Succ : N ^ 

N be the successor function and define /{0, 1}* — > N as follows: 

f{p) = u'msuccm 

If p{U^{p)) = n then U^{p) = Itn so that {p){Succ) is the function 
X ^ X + n and f{p) = {p){Succ){Q) = n. □ 

Remark 3.1. 

1) Conditions (*) and (**) both hold trivially in case p o is a partial 
recursive function or an effective functional. 

2) Theorem 13.21 relativizes to computability with an oracle. 

3.3 andir- 
Theorem 3.3. 

card —ct-f^ 

Proof. 

I) £ = PR(N ^ N). Let n E N and let p G {0, 1}* be a minimal length 
program which outputs n in unary through a possibly infnite computation. 
Then K'^{n) = \p\. Define h : {0, 1}* {0, 1}* such that h{p) is the fol- 
lowing program for a partial recursive function (Ph(p) : N — > N : 

^Ph{p) (*) = IF step t program p outputs 1 THEN 1 ELSE undefined 

Clearly, cardJ^ {U^ {h{p)) = n. The strong universality of insures that 
there exists e such that 

yp U'{h{p)) = U^{{e,p)) 



This leads to Kf^^^in) < K°°{n) + 2|e| + 1, whence K^^^^<ctK'^ 
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2) Let n E N and let p S {0, 1}* be a minimal length program such that 
cardJ^{U^{p)) = n. Define h : {0,1}* {0,1}* such that h{p) behaves as 
follows: 

• h{p) emulates some dovetailing of all computations U^{p){i) for i = 
0,1,2,..., 

• each time some computation U^{p){i) halts (i.e. a new point i is 
proved to be in the domain of U^{p)) then h{p) output 1. 

It is clear that h{p) outputs n in unary. Thus, K°^{n) < \h{p)\. But there 
is some constant c such that \h{p)\ = \p\ + c, whence K°^{n) < \p\ + c and 
therefore K°°<ctK^^rd- ° 

3.4 K^JNandK' 
Theorem 3.4. 

Proof. 

Now £ = {PR{N N))2 and is a pair of functions (C/f , U^). 

1) Let n G N and let p G {0, 1}* be a minimal length program such that 
card^{U^{p)) = card^{Uf{p)) - card^ {U^{p)) = n. Define h : {0,1}* ^ 
{0, 1}* such that h{p) is a program which uses oracle 0' and behaves as 
follows: 

• h{p) emulates some dovetailing of all computations f/f f/f (p) for 
i = 0,1,2,..., 

• At each computation step, h{p) asks the oracle whether there is still 
some computation that will halt. If the answer is "NO" then h(p) 
halts and outputs the difference of the number of points z's on which 
Ui{p) has been checked to converge and that for [/^(p) 

It is clear that h{p) outputs n. Thus, K'{n) < \h{p)\. But there is some 
constant c such that \h{p)\ = \p\ + c, whence K'{n) <\p\ + c and therefore 

2) Let n € N and let p € {0, 1}* be a minimal length program using oracle 
0' which outputs n in unary. Then K'{n) = \p\. To emulate computations 
using oracle 0', we shall use Chaitin's harmless overshoot technique [3j: 

• If an 3a; . . . assertion is true then a computation loop will check that 
it is true. 

• However, if it is false, there is no way to check it in finite time. 

• Whence the strategy to systematically answer "NO" to each 3x . . . 
question and then check this answer via a computation loop. 
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• Every false answer "NO" will be proved false at some time during this 
loop, giving a possibility to correct it. 

• Every computation using oracle 0' which halts uses finitely many ques- 
tions to the oracle. The above strategy will therefore be corrected only 
finitely many times so that it eventually leads for a fair emulation. 

Define h : {0,1}* ^ {0,1}* such that Uf{h{p)) and U^{h{p)) behave as 
follows: 

1. Ui{h{p)) emulates p and whenever p outputs 1 then Uf{h{p)) will 
converge on t where t is the current computation step. 

2. Each time p asks a question to oracle 0' of the form 3a; . . . ? then 
Uf{h{p)) answers "NO". 

3. Cautiously, Uf{h{p)) checks each of its oracle answers starting a com- 
putation loop which will halt only if the right answer was "YES" (in- 
stead of "NO"). 

4. In case some answer was false, then Ui{h(p)) restarts the whole em- 
ulation of p (correcting its past answers) and C/f(/i(p)) will converge 
on a set of points in bijection with that on which Uf{h{p)) was made 
converging before the answer was recognized to be false. 

Corrections brought in point 4 make the final difference 

carcF{U^{h{p))) - card^{Ui{h{p))) 

equal to n. 

The strong universality of insures that there exists e such that 

Vp(C/f(Mp)) = C/^((ei,p)) A Ul{h{p)) = U^{{e^,p))) 
This leads to K^^^ai^) < K'{n) + 2|e| + 1, whence K^^^^ \'^<ctK' . □ 



3.5 Kord and K"^ 
Theorem 3.5. 

Kord=ctK'^ 

Proof. 

Now £ = PRiN"^ N). 

1) Let n G N and let p G {0, 1}* be a minimal length program such that 
ord{U^{p)) = n. Define h : {0,1}* {0,1}* such that h{p) uses oracle 0' 
and behaves as follows: 

• h{p) initializes a set X of integers to 0. 
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• Step 0. h{p) checks if there is some pair with as a component which 
is in the domain of U^{p). If so it outputs a 1 and puts in the set 
X. 

• Step t > 0. h{p) checks if there is some chain (constituted of pairs 
in the domain of U^{p)) containing t and ah elements of X. If so it 
outputs a 1 and puts t in the set X. 

It is clear that, through an infinite computation, h{p) outputs the unary 
representation of the order type of the transitive closure of the domain of 
U^{p) in case it is a finite ordered type. Thus, K'°°{n) < \h{p)\. But there 
is some constant c such that \h{p)\ = \p\ + c, whence K'°°{n) < |p| + c and 
therefore i^'°°<ct-f^ord- 

2) Let n G N, n > and let p G {0, 1}* be a minimal length program using 
oracle 0' which outputs n in unary through an infinite computation. Then 
K'°°{n) = \p\. We shall again use Chaitin's harmless overshoot technique. 
Define h : {0, 1}* {0, 1}* such that U^{h{p)) behaves as follows: 

1. U^{h{p)) initializes a set X of integers to {0}. This set X will always 
be finite. 

2. U^{h{p)) emulates p and whenever p outputs 1 then a new point k 
is added to X and U^{h{p)) will converge on every pair {x,k) where 
xeX. 

3. Each time p asks a question to oracle 0' of the form 3x . . . ? then 
U^{h{p)) answers "NO". 

4. Cautiously, U^{h{p)) checks each one of its oracle answers starting 
computation loops which will halt only if some right answer was "YES" 
(instead of "NO"). 

5. In case some answer was false, then U^{h{p)) restarts the whole em- 
ulation of p (correcting its past answers) and U^{h{p)) wih converge 
on all pairs (x,y) G X"^ and the set X is reinitialized to {0}. 

Corrections brought in point 5 make the final transitive closure of the domain 
of U^{h{p)) a preordered set the quotient of which has exactly n points. 
The strong universality of insures that there exists e such that 

yp{JJ^{h{p)) = U^{{e,p)) 

This leads to K^rdin) < K'°°{n) + 2|e| + 1, whence Kord<ctK'°° ■ □ 



15 



References 



[1] V. Becher, S. Daicz, and G. Chaitin. A highly random number. In 
Combinatorics, Computability and Logic: Proceedings of the Third 
Discrete Mathematics and Theoretical Computer Science Conference 
(DMTCS'Ol), pages 55-68. Springer- Verlag, 2001. 

[2] G. Chaitin. A theory of program size formally identical to information 
theory. Journal of the ACM, 22:329-340, 1975. Available on Chaitin's 
home page. 

[3] G. Chaitin. Information theoretic characterizations of infinite strings. 
Theoret. Comput. Sci., 2:45-48, 1976. Available on Chaitin's home 
page. 

[4] M. Ferbus-Zanda and S. Grigorieff. Is randomnes native to computer 
science? Bull. EATCS, 74:78-118, 2001. Available on the author's 
home page. 

[5] A.N. Kolmogorov. Three approaches to the quantitative definition of 
information. Problems Inform. Transmission, l(l):l-7, 1965. 

[6] L. Levin. On the notion of random sequence. Soviet Math. Dokl., 
14(5):1413-1416, 1973. 

[7] M. Li and P. Vitanyi. An introduction to Kolmogorov complexity and 
its applications. Springer, 1997 (2d edition). 

[8] P. Odifreddi. Classical Recursion Theory, volume 125. North-Holland, 
1989. 

[9] H. Rogers. Theory of recursive functions and effective computability. 
McGraw-Hill, 1967. 

[10] A. Shen. Kolmogorov complexity and its applications. Lec- 
ture Notes, Uppsala University, Sweden, pages 1-23, 2000. 
|http:/ /www.csd.uu.se/~vorobyov/| Courses /KG / 2000 / all.ps. 

[11] R.M. Solovay. On random R.E. sets. In A.I. Arruda and al., editors, 
Non-classical Logics, Model theory and Computability, pages 283-307. 
North-Holland, 1977. 



16 



